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Abstract 

The field of exact exponential time algorithms for NP-hard problems has thrived over the 
last decade. While exhaustive search remains asymptotically the fastest known algorithm for 
some basic problems, difficult and non-trivial exponential time algorithms have been found 
for a myriad of problems, including GRAPH Coloring, Hamiltonian Path, Dominating 
Set and 3-CNF-Sat. In some instances, improving these algorithms further seems to be out 
of reach. The CNF-Sat problem is the canonical example of a problem for which the trivial 
exhaustive search algorithm runs in time 0(2"), where n is the number of variables in the input 
formula. While there exist non-trivial algorithms for CNF-Sat that run in time o(2"), no 
algorithm was able to improve the growth rate 2 to a smaller constant, and hence it is natural to 
conjecture that 2 is the optimal growth rate. The strong exponential time hypothesis (SETH) 
by Impagliazzo and Paturi [JCSS 2001] goes a little bit further and asserts that, for every 
e < 1, there is a (large) integer k such that that /c-CNF-Sat cannot be computed in time 2'". 

In this paper, we show that, for every e < 1, the problems Hitting Set, Set Splitting, 
and NAE-Sat cannot be computed in time 0(2^") unless SETH fails. Here n is the number of 
elements or variables in the input. For these problems, we actually get an equivalence to SETH 
in a certain sense. We conjecture that SETH implies a similar statement for Set Cover, 
and prove that, under this assumption, the fastest known algorithms for Steiner Tree, 
Connected Vertex Cover, Set Partitioning, and the pseudo-polynomial time algo- 
rithm for Subset Sum cannot be significantly improved. Finally, we justify our assumption 
about the hardness of Set Cover by showing that the parity of the number of solutions to 
Set Cover cannot be computed in time 0(2''") for any e < 1 unless SETH fails. 

*An extended abstract of this paper appears in the proceedings of CCC 2012. 
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1 Introduction 



Every problem in NP can be solved in time 2P°^y("*^ by brute force, that is, by enumerating 
all candidates for an NP- witness, which is guaranteed to have length polynomial in the input 
size m. While we do not believe that polynomial time algorithms for NP-complete problems 
exist, many NP-complete problems have exponential time algorithms that are dramatically 
faster than the naive brute force algorithm. For some classical problems, such as Subset Sum 



or Hamiltonian Cycle, such algorithms were known HK62 Bel62 even before the concept 



of NP-completeness was discovered. Over the last decade, a subfield of algorithms devoted to 
developing faster exponential time algorithms for NP-hard problems has emerged. A myriad of 
problems have been shown to be solvable much faster than by naive brute force, and a variety 
of algorithm design techniques for exponential time algorithms has been developed. 

What the field of exponential time algorithms sorely lacks is a complexity-theoretic frame- 
work for showing running time lower bounds. Some problems, such as Independent Set and 
Dominating Set have seen a chain of improvements [FGK09 RND09; Rob86; KLR09 , each 
new improvement being smaller than the previous. For these problems, the running time of the 
discovered algorithms seems to converge towards 0(C") for some unknown constant C, where n 
denotes the number of vertices of the input graphs. For other problems, such as Graph Col- 
oring or Steiner Tree, non-trivial algorithms have been found, but improving the growth 



rate C of the running time any further seems to be out of reach |BHK09 ; Ned09 . The purpose 



of this paper is to develop tools that allow us to explain why we are stuck for these problems. 
Ideally, for any problem whose best known algorithm runs in time 0(C"^), we want to prove 
that the existence of 0(c"')-time algorithms for any constant c < C would have implausible 
complexity-theoretic consequences . 



Previous Work. Impagliazzo and Paturi's Exponential Time Hypothesis (ETH) addresses the 
questi on whether NP-hard problems can have algorithms that run in "subexponential time" 



IPOl 



. More precisely, the hypothesis asserts that 3-CNF-Sat cannot be computed in time 2°^"') 
where n is the number of variables in the input formula. ETH is considered to be a plausi- 
ble complexity-theoretic assumption, and subexponential time algorithms have been ruled out 
under ETH for many decision problems IPZOl , parameterized problems CCF-l-05 LMSll 



approximation problems [Mar07 , and counting problems [DHM-l-12 . However, ETH does not 
seem to be sufficient for pinning down what exactly the best possible growth rate is. For this 
reason, we base our results on a stronger hypothesis. 

The fastest known algorithms for CNF-Sat have running times of the form 2'^~°(")poly(m) 
[Sch05 Willi , which does not improve upon the growth rate 2 of the naive brute force algorithm 
that runs in time 2"poly(m). Hence a natural candidate for a stronger hypothesis is that CNF- 
Sat cannot be computed in time 2^"poly(m) for any e < 1. However, we do not know whether 
our lower bounds on the growth rate of specific problems can be based on this hypothesis. 
The main technical obstacle is that we have no analogue of the sparsification lemma, which 
applies to fc-CNF formulas and makes ETH a robust hypothesis [IPZOl] . In fact, very recent 
results indicate that such a sparsification may be impossible for general CNF formulas fSSll]. 
For this reason, we consider the Strong Exponential Time Hypothesis (SETH) of Impagliazzo 
and Paturi 



IPOl IPZOl CIP09 



This hypothesis asserts that, for every e < 1, there is a 
(large) integer k such that fc-CNF-SAT cannot be computed by any bounded-error randomized 
algorithm in time 0(2'^"). In particular, SETH implies the hypothesis for CNF-Sat above, but 
we do not know whether they are equivalent. Since SETH is a statement about A;-CNF formulas 
for constant k = k{e), we can apply the sparsification lemma for every fixed /c, which allows us 
to use SETH starting point in our reductions. 
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Our results. Our first theorem is that SETH is equivalent to lower bounds on the time com- 
plexity of a number of standard NP-complete problems. 



Theorem 1.1. Each of the following statements is equivalent to SETH: 

(i) Ve < 13k. A;-CNF-Sat, the satisfiability problem for n-variable k-CNF formulas, cannot 
be computed in time 0(2'^"). 

(a) Ve < 1.3A;. A; -Hitting Set, the hitting set problem for set systems over [n] with sets of 
size at most k, cannot be computed in time 0(2"^"). 

(Hi) Ve < 1.3A;. /c-Set Splitting, the set splitting problem for set systems over [n] with sets 
of size at most k, cannot be computed in time 0(2"^"). 

(iv) Ve < 1.3A;. /c-NAE-Sat, the not-all-equal assignment problem for n-variable k-CNF for- 
mulas, cannot be computed in time 0{2^"'). 

(v) Ve < 1.3c. c-VSP-CiRCUiT-SAT, the satisfiability problem for n-variable series-parallel 
circuits of size at most cn, cannot be computed in time 0(2"^"). 

For all of the above problems, the naive brute force algorithm runs in time 0(2"). While 
there may not be a consensus that SETH is a "plausible" complexity-theoretic assumption, our 
theorem does indicate that finding an algorithm for CNF-Sat whose growth rate is smaller 
than 2 is as difficult as finding such an algorithm for any of the above problems. Since our 
results are established via suitable reductions, this can be seen as a completeness result under 
these reductions. Moreover, we actually prove that the optimal growth rates for all of the 
problems above are equal as k tends to infinity. This gives an additional motivation to study 
the Strong Exponential Time Hypothesis. 

An immediate consequence of Theorem [TTT] is that, if SETH holds, then CNF-Sat, Hitting 
Set, Set Splitting, NAE-Sat, and the satisfiability problem of series-parallel circuits do not 
have bounded-error randomized algorithms that run in time 2^"poly(m) for any e < 1. All of 
these problems are search problems, where the objective is to find a particular object in a search 
space of size 2". Of course, we would also like to show tight connections between SETH and the 
optimal growth rates of problems that do have non-trivial exact algorithms. Our prototypical 
such problem is Set Cover: Given a set system with n elements and m sets, we want to select 
a given number t of sets that cover all elements. Exhaustively trying all possible ways to cover 
the elements takes time at most 2'"poly(m). However, m could be much larger than n, and it 
is natural to ask for the best running time that one can achieve in terms of n. It turns out that 



a simple dynamic programming algorithm FKW04 can solve Set Cover in time 2"poly(m 



The natural question is whether the growth rate of this simple algorithm can be improved. While 
we are not able to resolve this question, we connect the existence of an improved algorithm for 
Set Cover to the existence of faster algorithms for several problems. Specifically, we show the 
following theorem. 

Theorem 1.2. Assume that, for all e < 1, there is a k such that Set Cover with sets of size 
at most k cannot be computed in time 2'^'^poly(m). Then, for all e < 1, we have: 

(i) Steiner Tree cannot be computed in time 2'^*poly(n), 
(a) Connected Vertex Cover cannot be computed in time 2^*poly(n), 
(Hi) Set Partitioning cannot be computed in time 2'^"'poly(m), and 
(iv) Subset Sum cannot be computed in time t'^poly(n). 
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All problems mentioned in this theorem have non-trivial algorithms whose running times are 
as above with e = 1 |BHK+07[ |Ned09t |CNP+11[ |FKW04t p:.R+09| . Under the assumption in 
the theorem, we therefore obtain tight lower bounds on the growth rate of exact algorithms for 
Steiner Tree, Connected Vertex Cover, Set Partitioning, and Subset Sum. The 
best currently known algorithms for these problems share two interesting common features. 



First, they are all dynamic programming algorithms. Thus, Theorem 1.2 hints at Set Cover 



being a "canonical" dynamic programming problem. Second, the algorithms can all be modified 
to compute the number of solutions modulo two in the same running time. In fact, the currently 



fastest algorithm CNP+ll for Connected Vertex Cover works by reducing the problem 



to computing the number of solutions modulo two. 



While Theorem 1.1 is an equivalence, Theorem 1.2 is not. One might ask whether it is 



possible to find reductions back to Set Cover and to strengthen Theorem 1.2 in this manner. 
We believe that this would be quite difficult: A suitable reduction from, say, Steiner Tree to 
Set Cover that proves the converse of Theorem 1.2 would probably also work for e = 1. This 
would give an alternative proof that Steiner Tree can be computed in time 2*poly(m). Hence, 
finding such a reduction is likely to be a challenge since the fastest known algorithms [BHK-|-07| 
Ned09 for Steiner Tree are quite non-trivial — it took more than 30 years before the clas- 
sical 3*poly(n)-time Dreyfus- Wagner algorithm for Steiner Tree was improved to 2*poly(n). 
Similar comments apply to Connected Vertex Cover since its 2*poly(n) time algorithm is 



quite complex CNP-l-11 



The hardness assumption for Set Cover in Theorem 1.2 needs some justification. Ide- 
ally we would like to replace this assumption with SETH, that is, we would like to prove that 
SETH implies the hardness assumption for Set Cover in Theorem 1.2 We do not know a 



suitable reduction, but we are able to provide a different kind of evidence for hardness: We 
show that a 2'^"poly(m)-time algorithm to compute the number of set covers modulo two would 
violate ©-SETH, which is a hypothesis that implies SETH. Formally, ©-SETH asserts that, 
for all e < 1, there exists a (large) integer k such that A;-©CNF-Sat cannot be computed in 
time 0(2^"). Here, /c-©CNF-Sat is the problem of computing the number of satisfying assign- 



ments of a given A;-CNF formula modulo two. It follows from known results |CIK-|-03; Tra08 



(see also Section 3.1) that, if SETH holds, then so does ©-SETH. As a partial justification for 
the hardness assumption for Set Cover in Theorem |1.2[ we provide the following theorem. 



Theorem 1.3. Each of the following statements is equivalent to ©-SETH.- 

(i) Ve < 1.3A;. A;-©CNF-Sat, the parity satisfiability problem for n-variable k-CNF formu- 
las, cannot be computed in time 0(2*^"). 

(a) Ve < 1.3k. A; -©Hitting Set, the parity hitting set problem for set systems over [n] with 
sets of size at most k, cannot be computed in time 0(2*^"). 

(Hi) Ve < 1.3k. A; -©Set Cover, the parity set cover problem for set systems over [n] with 
sets of size at most k, cannot be computed in time 0(2*^"). 



In the statement of Theorem 1.3 the ©Hitting Set and ©Set Cover problems are defined 



as follows: the input is a set system and the objective is to compute the parity of the number 



of hitting sets (resp. set covers) in the system. An immediate consequence of Theorem 1.3 that 
we find interesting is that ©-SETH rules out the existence of 2'^"'poly(m)-time algorithms to 
compute the number of set covers of a set system, for any e < 1. 



Theorem 1.3 together with the fact that the algorithms for all problems mentioned in Theo- 



rem 



1.2 can be modified to count solutions modulo two leads to the following questions: Can we 



show running time lower bounds for the counting versions of these problems? We show that this 
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Figure 1: Overview of all reductions we give. An arrow 11 — >• H' depicts a reduction from the 
problem 11' to the problem 11. In other words, improving the best-known algorithm for 11 implies 
that the best-known algorithm for H' can be improved as well. The thin arrowhead indicates 
the isolation lemma result known from previous work CIK-l-03 , Tra08 . The left group contains 
problems, for which the best-known algorithm is naive brute force, and is discussed in Section [3j 
The right group contains problems, for which the best-known algorithms are based on dynamic 
programming flavoured techniques, and is discussed in Section |4j The red and dashed arrow 



indicates the open problem whether SETH implies the assumption of Theorem 1.2 



is indeed possible. In particular we show that, assuming ©-SETH, there is no 2'^*poly(n)-time 
algorithm that computes the parity of the number of Steiner trees that have size at most t, and 
no 2^*poly(n)-time algorithm that computes the parity of the number of connected vertex covers 
that have size at most t. Thus, unless ©-SETH fails, any improved algorithm for Set Cover, 
Steiner Tree, or Connected Vertex Cover cannot be used to compute the parity of the 
number of solutions. 

We find it intriguing that SETH and 0-SETH can be used to show tight running time lower 
bounds, sometimes for problems for which the best algorithm has been improved several times, 
such as for Steiner Tree or Connected Vertex Cover. We feel that such sharp bounds 
are unlikely to just be a coincidence, leading us to conjecture that the relationship between the 
considered problems is even closer than what we show. Specifically, we conjecture that SETH 
implies the hardness assumption for Set Cover in Theorem |1.2[ This conjecture provides an 
interesting open problem. 

Our results are obtained by a collection of reductions. Section [3] contains the reductions 



that constitute the proof of Theorem and some of the reductions needed for Theorem 1.3 



Section |4] contains the proof of Theorem |1.2[ the remaining reductions for Theorem 1.3, and the 
hardness results for counting Steiner trees and connected vertex covers. A schematic represen- 
tation of our reductions can be found in Figure [T] 



2 Preliminaries and Notation 

In this paper, A denotes the symmetric difference and U denotes the disjoint union. For a set U 
and a positive integer i < \U\, we denote the family of all subsets of U of size i by (^). In this 
paper, = will always denote congruence modulo 2, that is, i = j holds for integers i,j if and 
only if i and j have the same parity. Every assignment a: {vi, . . . ,Vn} {0, 1} to n Boolean 
variables vi, . . . ,Vn is identified with the set A := {vi \ a{vi) = 1} C {vi, . . . , Vn}- 

Since we consider a significant number of problems in the paper, each of which has a few 
variants, we use the following notation for clarity. We write k-H for problems whose input 
consists of set systems of sets of size at most k, or CNF formulas with clauses of width at 
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most k. We write (k, c)-SPARSE-n if, in addition, the set systems or formulas are required to 
have density at most c. That is, the number of sets or clauses is at most cn, where n is the 
number of elements or variables. 

For each problem 11 that we consider, we fix the canonical NP-verifier that is implicit in 
the way we define the problem. Then every yes-instance of 11 has associated with it a set of 
NP-witnesses or "solutions". We write ©IT for the problem of deciding whether, for a given 
instance, the parity of the number of solutions odd. If solutions of 11 are sets (e.g., of vertices), 
we write ©til for the problem of deciding whether, for a given instance, the parity of the number 
of solution sets that have size exactly t is odd. 

Running times in this paper have the form • poly(m), where c is a nonnegative constant, 
m is the total size of the input, and n is a somewhat smaller parameter of the input, typically the 
number of variables, vertices, or elements. The constant c is the growth rate of the running time, 
and it may be different for different choices for the parameter. To make this parameterization 
explicit, we use the notation H/n. For every such parameterized problem, we now define the 
number a = a{Il/n). 

Definition 2.1. For a parameterized problem H/n, let a{Il/n) be the infimum over all e > 
such that there exists a randomized 2^'"'Tpoly (m) -time algorithm for H whose error probability is 
at most 1/3. 

The optimal growth rate of 11 with respect to n is C := 2'^(n/"). If the infimum in the 
definition above is a minimum, then 11 has an algorithm that runs in time C"poly(m) and no 
algorithm for 11 can have a running time c"poly(m) for any c < C. On the other hand, if the 
minimum does not exist, then no algorithm for 11 can run in time C"poly(m), but 11 has a 
c'^poly(m)-time algorithm for every c > C. We formally define SETH as the assertion that 
limfe^oo o-(fc-CNF-SAT/n) = 1. 

We remark that it is consistent with current knowledge that SETH fails and yet CNF-Sat 
does not have 2'^"poly(m)-algorithms for any e < 1: If SETH fails, then /c-CNF-Sat has, say, 
fc'^l.OQ^-time algorithms for every k, which does not seem to translate to a 2'^"poly(m)-time 
algorithm for CNF-Sat for any e < 1. 

3 On Improving Branching Algorithms 

In this section we show that significantly faster algorithms for search problems such as Hitting 
Set and Set Splitting imply significantly faster algorithms for CNF-Sat. More precisely, 
we prove that the growth rates of these problems are equal, or equivalently, (j(CNF-SAT/n) = 
cr(HlTTlNG Set/ti) = (j(Set SPLlTTlNc/n). We also give a reduction from ©CNF-Sat to 
©Hitting Set, thus establishing a connection between the parity versions of these two prob- 
lems. 

Given an n-variable CNF formula with m clauses, the problems CNF-Sat and ©CNF-Sat 
problems are to determine whether there exists a satisfying assignment and whether the number 
of satisfying assignments is odd, respectively. With the same input, the NAE-Sat problem is 
to determine whether there exists an assignment such that every clause contains both a literal 
set to true and a literal set to false. 

Given an integer t and a set system C 2^ with \J^\ = m and \U\ = n, the problems 
Hitting Set and ©Hitting Set are to determine whether there exists a hitting set of size 
at most t and whether the number of hitting sets is odd, respectively. A hitting set is a subset 
H C U such that i7 n / for every S € T. With the same input, the Set Splitting 
problem asks whether there is a subset X C. U such that, for every S E J^, we have S ^ X and 
S<^{U\X). 
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3.1 Previous results for CNF-SAT 



In the following few subsections, we show reductions from CNF-SAT/n to Hitting Set/u and 
Set SPLiTTiNC/n. These reductions work even when the given instance of CNF-SAT/n is 
dense, that is, when there is no bound on the number of clauses that is linear in the number 
of variables. However, our starting point in Section |4] is the Sparse-Hitting Set/ti problem, 
where the number of sets in the set system is linear in n. For this reason we formulate our 
results for the sparse versions of Hitting Set/h and Set Splitting/tt,, and we develop a 
sparse version of SETH first. 



The sparsification lemma by Impagliazzo et al. IPZOl) is that every fc-CNF formula ip can 
be written as the disjunction of 2"^" formulas in fe-CNF, each of which has at most c{k, e) • n 
clauses. Moreover, this disjunction of sparse formulas can be computed from ip and e in time 
2'^"' • poly(m). Hence, the growth rate of /c-CNF-Sat for formulas of density at most c{k,e) is 
e-close to the growth rate of general /c-CNF-Sat. More precisely, for every k and every e > 0, we 
have cT((A;,c)-SPARSE-CNF-SAT/n) < a(A;-CNF-SAT/n) < cj((A;,c)-SPARSE-CNF-SAT/n) + e, 
where the first inequality is trivial and the second inequality follows from the sparsification 
lemma. The density c = c{k, e) is the sparsification constant, and the best known bound is 
{k/ef' 



c{k,e) = 
theorem 



CIP06 . By setting e = e{k) = this immediately yields the following 



Theorem 3.1 ( [IPZOl 



CIP06 



). For every function a = c{k) > {u}{k))'^^ , we have 



lim crffc-CNF-SAT/n) = lim cr('(fc,c)-SPARSE-CNF-SAT/n 



Hence, SETH is equivalent to the right-hand side being equal to 1. In |DHM+12 



it was 

observed that the sparsification lemma can be made parsimonious, which gives the following 
equality for the same functions c = c{k): 



lim o- A;-eCNF-SAT/n 

fe— s>oo 



lim cr (A;,c)-®SPARSE-CNF-SAT/n 



We define 



-SETH as the assertion that these limits are equal to 1. The isolation lemmas 

-SETH. More 



for fe-CNF formulas CIK+03| Tra08 immediately yield that SETH implies 

c7(A:-®CNF-SAT/n 



precisely, we have the following theorem. 

Theorem 3.2 ( |CIK+03t [TVaOS) ) . lim^^oo o-(^-CNF-SAT/n) < limfc^oo ■ 



3.2 From CNF-SAT to Hitting Set 



The following construction will be useful in this subsection and in Subsection 3.4 Given a CNF 
formula = Ci A . . . A C„i over n variables vi, . . . ,Vn and an odd integer p > 3 that divides n, 
we construct the set system J'lp^p ^ 2^ as follows. 

1. Let p' be the odd integer p' = p + 2[log2p] , and let U = {ui, . . . , with n' = p' ■ n/p. 

2. Partition the variables of ip into blocks Vi of size p, i.e., Vi := {upj+i, . . . , 

3. Partition U into blocks Ui of size p' , i.e., Ui = {up/j+i, . . . ,iip'(j+i)}. 



4. Choose an arbitrary injective function ^/'j : 2 



Ui 
\p//2\ 



P' 



2P 

> — > 



\p'/2-] 
2V 



p + 2 [log2 p] 



. This exists since 



> 2P = |2^H 
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We think of tpi as a mapping that, given an assignment to the variables of Vi, associates 
with it a subset of Ui of size \p' /2] . 

5. If X G (|-p^*2]) ^^"^ some i, then add the set X to Tip,p- 

6. If X G ([2,72]) ^^'^ some i such that \ X}) = 0, then add the set X to 

7. For every clause C of do the following: 

o Let -f = {l<i<^|C contains a variable of block Vj}\ 
o For every i G i", we let ^ be the set 

some assignment in ipi^{{Ui \ A\) sets all variables in C fl to false| ; 

o For every tuple {Aiji^j with Ai G Ai, add the set IJjgj-^i to J^ip^p- 

Lemma 3.3. For every n-variable CNF formula ip and every odd integer p > 3 that divides n, 
the number of satisfying assignments of ip is equal to the number of hitting sets of size f^]^ of 
the set system T^^p, where p' = p + 2[log2p] . 

Proof. For convenience denote 5 = f • Define V: 2^ ^ 2^ as ip{A) = Uf=i n Vi). Note 
that is injective, since for every i, V'i is injective. Hence to prove the lemma, it is sufficient 
to prove that (1) ^ is a satisfying assignment if and only if ip{A) is a hitting set of size \^'\g, 
and (2) if there is no assignment A^V such that V'(^) = H, than no set H C U of size \^]g 
is a hitting set of J-^^p. 

For the forward direction of (1), note that the sets added in Step 5 are hit by the pigeon-hole 
principle since \ipi{A nVi)\ = \^] and p' is odd. For the sets added in Step 6, consider the 
following. The set X of size [p'/2\ is added because for some i, ^-\{Ui\X}) = 0. Thus 
ipi{A nVi) automatically hits X . For the sets added in Step 7, consider a clause C of (p and 
the associated index set / as in Step 7. Since ^ is a satisfying assignment of ip, there exists 
i e I such that A sets at least one variable in C fl to true. Hence, Ui \ i^iiA n V^) At. On 
the other hand, Ui \ il^i{A fl Vi) is the only member of T,p^p that cannot be hit by 'tp{A fl Vi). 
Therefore, all sets added in Step 7 are hit by i>{A). It is easy to check that tp{A) has size \^]g 
since there are g blocks. 

For the reverse direction of (1), let A he an assignment such that il^{A) is a hitting set of size 
\^]g. We show that A is a satisfying assignment of (p. Suppose for the sake of contradiction 
that a clause C is not satisfied by A, and let / be as defined in Step 7 for this C. Since ?/'(^) is 
a hitting set, IV'(^) H > ^ for every i because it hits all sets added in Step 5. More precisely, 
|V'(^)n[/i| = [y] because IV'I^)! = \^]d s-^id there are g disjoint blocks Ui, . . . , Ug. Therefore, 
\Ui \ iIj{A)\ = LyJ> and so Ui n V(^) = Ui\ {Ui \ ipiA)) is a member of A for every i. This 
means that in Step 7 the set Uie/ '^i^h Ai = Ui \ il^{A) was added, but this set is not hit by 
V'(^). So it contradicts that il^{A) is a hitting set. 

For (2), let H <^U he a set of size \^~\g and assume that there is no assignment ACIV such 
that ip{A) = H. We show that H is not a hitting set of J-ip^p. For the sake of contradiction, 
suppose that if is a hitting set. Then, as in the proof of the reverse direction of (1), we 
obtain \H fl Ui\ = [^1 fo^" every i. Since it hits all sets added in Step 6, we also know that 

every i. However, this contradicts the non-existence of ^ C F such that 
V'(A) = H. □ 
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Theorem 3.4. For every function c = c{k), there exists a function c' = c'{k') such that 



lim (T((A;,c)-SPARSE-CNF-SAT/n) < lim (j((A;',c )-Sparse-Hitting SEx/n) . 

Proof. To prove the theorem we show that for any positive integers k, c and for any positive 
odd integer p > 3, there exist positive integers k' and c' such that 

(7((A:,c)-SPARSE-CNF-SAT/n) < cj((A;',c')-Sparse-Hitting SEx/n) + O f 

V P 

Create the set system F^p^p as described above. For a constant p, this can clearly be done in 
polynomial time. We set k' = p'k and c' = 2p' + 2^'^ c (remind that p' = p + 2[log2p]). It is 
easy to see that the maximum size of a set of Fip^p is at most k' . Let m' be the number of sets in 
J^tp,p- Observe that there are at most 2^ n/p sets added in Step 5 and Step 6. Moreover, since 
each clause contains variables from at most k blocks, there are at most 2^^^ m sets added in Step 
7. Therefore m' /n' < m' /n < 2^ + 2^^ c = d and we can determine the minimum hitting set of 
J"<^,p in o(2^'''=')-Sparse-Hitting SET/n)n'^0(i)) ^j^^g^ ^Yidid n' is the size of the universe of F^^p. 

if is satisfiable if and only if the size of a minimum hitting set is [^] -. Since 



By Lemma 



3.3 



n' = ^(j5 + 2[logj9]) = n(l + 0(^)), the theorem follows. □ 

3.3 From Hitting Set via Set Splitting to CNF-SAT 

Theorem 3.5. 

lim (T(fc-HlTTlNG Set/ti) < lim cr(A;-SET SPLlTTlNC/n) . 

Proof. Observe that to prove the theorem it is enough to show that for every positive integers 
k,p we have 

cr(fc-HlTTING SET/n) < cr(A;'-SET SPLITTINC/n) + - ^ 



P 

where k' = max(A; + l,p + 1). Let {F,t) be an instance of A;-Hitting Set. We can assume 
that the universe U of F has n elements and that p divides n. Let C/ = C/i U . . . U Un/p be a 
partition in which each part has exactly \Ui\ = p elements of the universe U. Let ti, . . . ,tn/p 

be nonnegative integers such that Yl7=i^i ~ ^- "^^^ ^'^^ current guess for how many 
elements of a t-element hitting set will intersect with the C/j's. The number of ways to write t 
as the ordered sum of n/p nonnegative integers ti, . . . , tn/p with < < p can be bounded by 
{p + = 2"/^''^°S2(P+^). For each choice of the tj's, we construct an instance F' of /c'-Set 

Splitting as fohows. 

1. Let R (red) and B (blue) be two special elements and add the set {i?, B} to F' . 

2. For all i with ti < p and for all X G (j^'^J, add X U {R} to F' . 

3. For every F G J", add Y U {B} to F' . 

Clearly F' can be computed in polynomial time and its universe has n + 2 elements. The sets 
added in step 2 have size at most p + 1 and the sets added in step 3 have size at most k + 1. 
Given an algorithm for Set Splitting, we compute F' for every choice of the tiS and we decide 
Hitting Set in time 0(2('=+°'('='-Set SPLiTTiNG))-nj^O(i)>)_ remains to show that F has a hitting 
set of size at most t if and only if F' has a set splitting for some choice of ti, . . . , tn/p- 
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For the completeness of the reduction, let H he a hitting set of size t and set ti = \Ui Ci H\ 
for all i. We now observe that H U {R} and its complement {U — H) U {B} form a set splitting 
of J^' . The set {R, B} added in step 1 is split. The sets X U {R} added in step 2 are split since 
at least one of the U + 1 elements of X <Z Ui is not contained in H. Finally, the sets Y U {B} 
added in step 3 are split since each Y £ has a non-empty intersection with H. 

For the soundness of the reduction, let {S, S) be a set splitting of T' for some choice of 
ti, . . . ,t„/p- Without loss of generality, assume that R & S. By the set added in step 1, this 
means that B G S. The sets added in step 2 guarantee that UiCiS contains at most ti elements 
for all i. Finally, the sets added in step 3 make sure that each set Y £ has a non-empty 
intersection with S. Thus, S \ {R} is a hitting set of and has size at most Yli U = t. □ 

Observation 3.6. For any positive integer k we have 

a{k-SET SPLiTTiNG/n) < cr(A;-NAE-SAT/n) < cr(A;-CNF-SAT/n) . 

Proof. For the first reduction, let J- be an instance of fc-SET Splitting. We construct an 
equivalent fc-CNF formula f as follows. For each element in the universe of J-, we add a 
variable, and for each set X £ we add a clause in which each variable occurs positively. 
A characteristic function of a set splitting U = f/i U C/2 is one that assigns 1 to the elements 
in Ui and to the elements of U2- Observe that the characteristic functions of set splittings 
of J- stand in one-to-one correspondence to variable assignments that satisfy the NAE-Sat 
constraints of (p. Thus, any algorithm for /c-NAE-Sat works for /c-Set Splitting, too. 

For the second reduction, let if he a /c-NAE-SAT-formula. The standard reduction to k- 
CNF-Sat creates two copies of every clause of (p and flips the sign of all literals in the second 
copies. Then any NAE-SAT-assignment of ip satisfies both copies of the clauses of if' . On the 
other hand, any satisfying assignment of 99' sets a literal to true and a literal to false in each 
clause of ip. Thus any algorithm for /c-CNF-Sat works for /c-NAE-Sat, too. □ 



3.4 From Parity CNF-SAT to Parity Hitting Set 

Given a CNF formula ip over n variables and clauses of size at most k and an odd integer p > 2 



that divides n, we first create the set system -F<^,p C 2 as described in Section 3.2 Given the 
set system T^^p C 2^ , create the set system J^!p^p as follows: 



For every block Ui'. 

add a special element to the universe, 

( u. 



o 



for every X G (|„72|)' ^^"^ ^ 't^*} family. 



Lemma 3.7. The number of hitting sets of the instance T^p^p of size \pJ I2 \ - is odd if and only 
if the number of hitting sets of the instance T'^ ^ is odd. 

Proof. Let g = ^- We first prove that the number of hitting sets of J~ip,p of size \p' /2']g is equal to 



the number of hitting sets H' oiJ^'^ p such that \H'r\Ui\ = [^] for every 1 < i < g. Suppose that 
if is a hitting set of T^^p of size \p' /2']g, then it is easy to see that H U {ei, . . . , Cg} is a hitting 
set of since all the sets added in Step 8 are hit by some Cj, and indeed \H' nUi\ = [^] for 
every 1 < i < g since otherwise the set Ui \ H' added in Step 5 is not hit by H' . For the reverse 
direction, suppose H' is a hitting set of 7"^^ such that \H' n Ui\ = \^~\ for every I < i < g. 
Then {ei, . . . , Cg} C H' since all the sets added in Step 8 are hit by H' . And hence we have a 
bijection between the two families of hitting sets. 
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For every hitting set H' of J~'ip^p and block [/j, we know that \H' r\Ui\ > \p' /2\. So it 
remains to show that the number of hitting sets H' of ^'^p^p such that there is an 1 < i < with 
\H' r\Ui\ > is even. Given such a hitting set H' , let 'j{H') = H'A{ei} where i is the smallest 
integer such that \H' n Ui\ > [^1- Obviously 7 is its own inverse and |7(-ff') H Ui\ > [^] so 
now it remains to show that ^{H') is also a hitting set of -T^^^p- To see this, notice that all sets 

X U {ej} added in Step 8 where X G ([^72]) ^'^^ '^^^ since \^{H') n > [^] and that those are 
the only sets containing ej. □ 

Theorem 3.8. For every function c = c{k), there exists a function c' = c'{k') such that 
lim (T((A;,c)-©SPARSE-CNF-SAT/n) < lim (t((/c',c')-©Sparse-Hitting SEx/n) . 

Proof. To prove the theorem we show that for any positive integers k, c, p, there exist positive 
integers k' , c', such that we have 

ct((/c, c)-©SPARSE-CNF-SAT/n) < (T((/i;',c')-©SPARSE-HiTTiNG SET/n) + 

Create the set system ^^^p as described above. For a constant p, this can clearly be 
done in polynomial time. Recall that there are at most (2^' + 2kp'c)n sets in J'ip^p, each 
of size at most p'k. Since in Step 8 we add at most 2^ n/p sets, each of size at most p' , 
we infer that T'^p is an instance of (A;',c')-©Sparse-Hitting Set/to, where k' = p'k and 
c' = 2^'^^ + 2kp'c. Therefore we can determine the number of hitting sets modulo 2 of J^'^p^p in 
Q(2'^((fc'=c')-eSPARSE-HiTTiNG SET/n)n' ^o(i) ) ^^^g^ ^^^^^ ^/ jg ^j^g gj^g ^j^g uuivcrse of -F^^p. Since 

n' = \^]{p + 2\logp]) = n(l + 0(^)), the theorem follows. □ 

Note that conversely, an improved algorithm for ©CNF-Sat gives an improved algorithm 
for ©Hitting Set: given a set family J-" C {7 the required reduction simply associates a variable 
with the elements of U and creates a CNF-formula with for every S €z J- a clause which is a 
disjunction of the variables associated with the elements of S. The correspondence between 
hitting sets and satisfying assignments is then immediate. Also, using a construction dual to 
this, a similar relation between ©CNF-SAT/m and Set Cover can be shown. 




3.5 Satisfiability for Series-Parallel Circuits 

In this subsection, we show that the satisfiability of cn-size series-parallel circuits can be decided 
in time time 2'^" for 6 < 1 independent of c if and only if SETH is not true. Here the size 
of a circuit is the number of wires. Our proof is based on a result of Valiant regarding paths 



in sparse graphs [Val77 . Calabro Cal08 discusses various notions of series-parallel graphs and 
provides a more complete proof of Valiant's lower bound on the size of series-parallel graphs 
(which he calls Valiant series-parallel graphs) that have "many" long paths. We remark that 
the class of Valiant series-parallel graphs is not the same as the notion of series-parallel graphs 



used most commonly in graph theory (see iCalOS 



In this section a multidag G = {V, E) is a directed acyclic multigraph. Let input(G) denote 
the set of vertices v G V such that the indegree of in G is zero. Similarly, let output (G) denote 
the set of vertices v € V such that the outdegree of f in G is zero. A labeling of G is a function 
/: y — )• N such that V(n, f) G E, l{u) < l{v). A labeling / is normal if for all v £ input(G), 
l{v) = and there exists an integer d G N such that for all v G output(G) \ input(G), l{v) = d. 
A multidag G is Valiant series-parallel (VSP) if it has a normal labeling / such that there exist 
no {u,v), {u',v') G E such that l{u) < l{u') < l{v) < l{v'). 



10 



We say that a boolean circuit C is a VSP circuit if the underlying multidag of C is a VSP 
graph and the indegree of every node is at most two (namely, the fan-in of each gate is at 
most two). Using the depth-reduction result by Valiant |Val77 and following the arguments by 
Calabro |Cal08| and Viola |Vio09 , we may show the following. 

Theorem 3.9. Let C be a VSP circuit of size cn with n input variables. There is an algorithm 
A which on input C and a parameter d > \ outputs an equivalent depth-3 unbounded fan-in 
OR-AND-OR circuit C with the following properties. 

1. Fan-in of the top OR gate in C is bounded by 2"/^^. 

2. Fan-in of the bottom OR gates is bounded by 2^^'"* where /i is an absolute constant. 

3. A runs in time 0(2"/'^n'^^^^) if c and d are constant. 



In other words, for all d > 1, Theorem 3.9 reduces the satisfiability of a cn-size VSP circuit 
to that of the satisfiability of a disjunction of 2"/'^ fc-CNFs where k < 2'^'^"" in time 0(2"/'^n'^(i)). 
This implies that 

a(c-VSP-CiRCUiT-SAT/n) < cj(22'"'-CNF-SAT/n) + ^. 

Hence, we obtain the following theorem. 
Theorem 3.10. 



lim CT(c-VSP-CiRCUiT-SAT/n) < lim cj(A;-CNF-SAT/n). 

c— >oo fc— !>oo 

For the reverse direction, observe that a CNF formula with cn clauses, all of size at most k, 
can be written as a 4cfc-size VSP circuit. This observation implies that 

cj((A:,c)-SPARSE-CNF-SAT/n) < cr(4cA:-VSP-CiRCUiT-SAT/n). 



Together with the sparsification lemma. Theorem 3.1 we obtain the following theorem. 
Theorem 3.11. lim^^oo ^^(^-CNF-SAT/n) < limc^oo o-(c-VSP-CiRCUiT-SAT/n) . 



4 On Improving Dynamic Programming Based Algorithms 

In this section we give some reductions that show that several dynamic programming based 
algorithms cannot be improved unless (the parity version of) CNF-Sat can be, using the 
hardness of ©Hitting Set/h showed in the previous section. More specifically, we show that 
©Hitting Set/tt, and ©Set CovER/n are equivalent using a simple but novel property of 
bipartite graphs in Subsection |4.1[ and in Subsection |4.2| we show that the current algorithms 
for ©fSTEiNER TREE/t and ©(Connected Vertex Cover//c are at least as hard to improve 
as the algorithm for ©Set CovER/n. Motivated we make the hypothesis that the current 
algorithm for Set Cover can not be improved and show similar implications to the Steiner 
TREE/i and Connected Vertex Cover/A:, Set Partitioning and Subset Sum problems. 

Given an integer t and a set system <Z 2^ where \ J-\ = m and |?7| = n, the Set Cover 
and ©Set Cover problems ask to determine whether there is a hitting set of size at most t and 
whether the number of hitting sets if odd, respectively. Here a set cover refer to a subset CJ- 
such that UsgcC = U . Given a graph G = iV., E), with \ V\ = n a subset TCI/, and an integer 
t the Steiner Tree and ©f Steiner Tree problems ask to determine whether is a hitting set 
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of size at most t and whether the number of hitting sets is odd, respectively. Here, a Steiner tree 
is a subset T O X O V such that X induces a connected graph in G. Given a graph G = {V, E) 
with |F| = n and an integer t, the Connected Vertex Cover and ©tCoNNECTED Vertex 
Cover problems ask to determine whether there is a connected vertex cover of size at most 
t and whether the number of connected vertex covers is odd, respectively. Here, a connected 
vertex cover is a subset X C-V such that X n e 7^ for every e G E and X induces a connected 
graph. We will also use the extended notation as explained in Section [2] denoting several variants 
of these problems (see also the appendix). 

4.1 The flip: Parity Hitting Set equals Parity Set Cover 

Lemma 4.1. Let G = {AU B,E) be a bipartite graph, then the number of independent sets of 
G modulo 2 is equal to 

\{X <ZA: N{X) = B}\. 

Proof. Grouping on their intersection with A, the number of independent sets of G is equal to 
Y^2\B\NiX)\^ 20 = \{xcA:NiX) = B}\ 

XCA XCA 

\B\N{X)\=0 

and the lemma follows. □ 



It is worth mentioning that this lemma was inspired by a non-modular variant from [NRIO 
Lemma 2] (see also [vRoll Proposition 9.1]). 



Theorem 4.2. cr(©HiTTiNG Set/u) = (t(©Set CovER/n) . 

Proof. Given a set system C 2^, let G = (J-", U, E) be the bipartite graph where {S, e) G E \i 
and only if e € /S. Note that the number of hitting sets of J- is equal to \{X C JJ : N[X) = J-}\. 



Then by Lemma 4.1 the number of hitting sets is equal to the number of independent sets of G 
modulo 2. And similarly, since the lemma is symmetric with respect to the two color classes of 
the bipartite graph, the number of set covers of J- is also equal to the number of independent 
sets of G modulo 2. Thus the problems are equivalent. □ 



Observe that in the proof of Theorem 4.2 the same set system is used as an instance of 



©Hitting Set/h and ©Set CovER/n. Hence the above directly gives the following corollary, 
which we will need in the next subsection. 

Corollary 4.3. For every function c = c{k), there exists a function d = c'{k') such that 
lim cr((/c,c)-©SPARSE-HiTTiNG SET/n) < lim ct((A:,c)-©Sparse-Set CovER/n) . 



4.2 From Set Cover to Steiner Tree and Connected Vertex Cover 

In this subsection we will give reductions from Set Cover/ti to Steiner TREE/t and Con- 
nected Vertex Cover/A;. We transfer the reductions to the parity versions ©Set Cover/ti, 
©tSTEiNER TREE/t, and ©tCONNECTED VERTEX Cover/Zc. For the reduction, we first need 
an intermediate result, showing that Set CovER/(n + t), that is. Set Cover parameterized by 
the sum of the size of the universe and solution size, is as hard as Set Cover/tt, (and similarly 
for ©Set Cover/tt, and ©Set Cover/(tt + t)). Once we have this intermediate result, the 
reductions to the ©(Steiner Tree/^ and ©tCoNNECTED Vertex Cover/A; problems follow 
more easily. 
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Theorem 4.4. limk_^oo (^{kSET CoVER/n) < liuik^ao <^{k-SET CoVER/(n + t)) . 

Proof. As a proof we present a reduction which for fixed a > transforms an instance {J", U, t) 
of fc-SET Cover into an instance of A;'-Set Cover, for some positive integer k' , where the size 
t' of the solution in the resulting p'-SET Cover instances is at most a\U\, without changing 
the universe size. 

Without loss of generality, we assume that t < \U\. Consider any a > 0. Let q be the 
smallest positive integer such that ^ < a. We may assume that t is divisible by q, since 
otherwise we may add at most q additional elements to the universe U and singleton sets to 
the family J^. We form a family J^' of all unions of exactly q sets from J^, that is for each 
of ('"^') choices of q sets Si, . . . ,Sq G J" we add to T' the set Ui=i ^i- Note that since g is a 
constant we can create T' in polynomial time. We set t' = t/q < \U\/q < a\U\. It is easy to see 
that (J", U, t) is a YES-instance of fc-SET Cover if and only if {J^', U, t') is a YES- instance of 
qk-SsT Cover. □ 

Observe that in the proof above, because of the grouping of q sets, one solution for the 
initial instance may correspond to several solutions in the resulting instance. For this reason 
the counting variant of the above reduction is much more technically involved. 

Theorem 4.5. For every function c = c{k), we have 

lim cr((A;,c)-©SPARSE-SET CoVER/n) < lim a{k'-®SwT CoVER/(n + i)) 

The involved proof is postponed to the end of this section, but first let us look at its 
consequences. 

Theorem 4.6. 

lim (7(A;-Set CoVER/(n + t)) < cr(STElNER TREE/i) , and 

k—^oo 

lim a{k-®SET COVER/(n + t)) < cr(©tSTEINER Tree/*) . 

Proof. Given an instance of Set Cover consisting of a set system (J-", U) and integer i, let G' 
be the graph obtained from the incidence graph of {T, U) hy adding a vertex s universal to 
with a pendant vertex u, and define the terminal set to be U {u}. It is easy to see that the 
number of Steincr trees with |?7| + i + 1 edges is equal to the number of set covers of {T, U) of 
size i. Hence the theorem follows. □ 

Theorem 4.7. 

lim (T(fc-SET COVER/(n + t)) < (j(CONNECTED VERTEX COVER/t), and 

k—^OD 

lim c7(A:-©(Set CovER/(n + t)) < <T(©tCoNNECTED Vertex CovER/t). 

fe-^oo 

Proof. Given an instance (J", U, t) of Set Cover, we create an instance of Connected Ver- 
tex Cover with G being obtained from the incidence graph of {J-, U) by adding a vertex s 
adjacent to all vertices corresponding to sets and adding pendant vertices for every element of 
U U {s}. Moreover let t' = t + \U\ + 1 in the Connected Vertex Cover instance. 

It is easy to see that for every i, there exists a set cover of {T, U) of size i < t \i and 
only if there exists a connected vertex cover of G of size at most i + \ U\ + 1 < t' since we can 
take without loss of optimality all vertices having a pendant vertex, and then connecting these 
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vertices is equivalent to covering all elements of U with sets in J^. Hence, by using an algo- 
rithm for Connected Vertex Cover, we obtain an o(2'^(connected vertex covER/t)t'„o(i)-) ^ 
Q(2<^(CoNNECTED Vertex CovER/t)(|c/|+i)„0(i)) ^^^g algorithm for p-©tSET Cover. 

For the parity case, let us study the number of connected vertex covers of size j of G for 
every j. Similarly to the previous case, note that for any connected vertex cover C, C CiT must 
be a set cover of (J^, U) hy the connectivity requirement. Hence we group all connected vertex 
covers in G depending on which set cover in (J", U) their intersection with is. Let cj be the 
number of connected vertex covers of G of size j and Sj be the number of set covers of size i in 
(7", U), then: 

h '\i-'-w\-i 

Now the number Sj modulo 2 can be determined in polynomial time once (ci, . . . , Cj_|_|[/|_|_i) 
modulo 2 are computed by recovering si up to Si in increasing order, since for i = j — \U\ — 1 
we have = 1. 

Thus, if in time 0(2<^(Connected Vertex CovER/t)t'^0(i)) compute the number of con- 

nected vertex covers of size n modulo 2, we can compute the parity of all (ci, . . . , Cj_|_|[/|_|_i) and 
hence the parity of Si in 0(2^(Connected Vertex CovER/t)(|C7|+t)„0(i))_ □ 

4.3 From Set Cover to Set Partitioning and Subset Sum 
Theorem 4.8. 

hm ct(p-Set CoVER/n) < hm crfp-SET PARTlTlONlNc/n). 

p->0O P->CXD 

Proof. Let {F,t) be an instance of p-SET Cover. Create an instance {F' jt) of p-SET Parti- 
tioning by for every S e adding all subsets of S to J^'. Clearly {F' ,t) has a set partitioning 
of size at most t if and only if (J^, t) has a set cover of size at most t. Since the size of the sets 
in T is bounded by p, the reduction runs in polynomial time. □ 

Theorem 4.9. 



lim cr(fc-SET PARTITIONING/n) < (t(SUBSET SUM/m). 

Proof. Let F he an instance of A;-Set Partitioning. We iterate over all potential sizes 
I <tQ <n oi the solution for the Set Partitioning problem. 

Wc create an instance of Subset Sum as follows. Let the target integer t for Subset 
Sum have a bit expansion consisting of three fields. First, as the most significant bits, a 
field coding the value of to, to check the cardinality of the solution C C J^; second, a field of 
length log2 to + log2 n containing the value n, to check the total size of all sets in C; finally, a 
field of length log2 + n containing n ones. The paddings of length log2 Iq serve to isolate the 
fields from each other. For every Si € we create an integer Oj with the same field division 
as t, where the first field encodes 1, the second field encodes l^jl, and the third field contains a 
one in position j if and only if Uj G Si. We argue that the resulting Subset Sum instance is a 
YES-instance if and only if T contains a partitioning of U using exactly to sets. 

Clearly, if C C partitions U and \C\ = to, then the integers corresponding to Si G C 
sum to t. The first field sums to to by cardinality of C, the second sums to n, and in the third 
field the non-zero digits are simply partitioned between the a^. 
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So let A he a. collection of integers aj that sum to t. By the first field, we have \A\ < to; 
thus the padding of length log to is enough to isolate the fields, and we have \A\ = to. By the 
same argument on the second field, the sum over all G ^ of the number of non-zero bits in 
the third field is exactly n. Now, the only way that the third field can actually contain n true 
bits is if the true bits in the third field are partitioned among the Oj. Thus, C = {Si \ ai £ A} 
is a set partitioning of U of cardinality exactly to- 

By looping over all 1 < to < t for the Set Partitioning instance, this solves the problem. 
Note that the length of the bit string t is n+0(log n) , which disappears into the asymptotics. □ 

4.4 Proof of Theorem 14.51 

As a proof we present a reduction which for fixed a > transforms an instance (J-"', U') of {k,c)- 
®Sparse-Set Cover into polynomially many instances of the k'-Bt^ET Cover problem, for 
some positive integer k' , where the size t of the solution in the resulting A;'-©(Set Cover 
instances is at most q;|C/'|. 

In order to find the parity of the number of all set covers of the instance (J-"', U') we find the 
parity of the number of set covers of a particular size. That is we iterate over all possible sizes 
j = 1, . . . , \ J-'\ of a set cover. Let us assume that we want to find the parity of the number of 
set covers of size j and for each positive integer j' < j we know the parity of the number of set 
covers of (J^', U') of size j'. Let q be the smallest power of two satisfying '—^ + 2 < a|C/'|. We 
assume that a\U'\ > 3 since otherwise the instance is small and we can solve it by brute force 
(recall that a is a given constant). Observe that q is upper bounded by a constant independent 
of \U'\ since \J^'\ < c\U'\. 

We create a temporary set system {To, Uo) to ensure that the size of the set covers we are 
looking for is divisible by q. Let r = j mod q. We make {Tq, Uq) by taking the set system 
(J^', U') and adding q — r new elements to the universe Uq and also q — r singleton sets of the 
new elements to the family J^o- Now we are looking for the parity of the number of set covers 
of size jo = j + {q — r) in (J"o) Uo)- Observe that for each / < jo we know the parity of the 
number of set covers of size j' in {Tq, Uo) since it is equal to the parity of set covers of {T' , U') 
of size j' — {q — r) < j which we already know. 

To obtain a A;'-©tSET Cover instance we set U* = Uo and we form a family J^* of all unions 
of exactly q sets from To, that is for each of ('"^°') choices of q sets 5i, . . . , 5^ G .Fq we add to 
J-* the set Uf^i Si (note that J-* might be a multiset). Finally we set t* = jo/q which is an 
integer since j + {q — r) is divisible by q. Observe that t* < ^ + 1 < a\U'\ — 1, by the definition 
of q, but {F* ,U* ,t*) might not be a proper instance of feg-StSET Cover, since F* could be 
a multiset. Note that each subset of U* appears in F* at most (2'='?)'' = times, since Fo 
has no duplicates and each set in F* is a union of exactly q sets from Fo- To overcome this 
technical obstacle we make a new instance {F, U,t), where as U we take U* with z = 1 + kq^ 
elements added, U = U* U {ei, . . . , e^}. We use elements {ei, . . . , Cz-i} to make sets from F* 
different in F by taking a different subset of {ei, . . . , Cz-i} for duplicates. Additionally we add 
one set {ei, . . . , e^} to the family F and set t = t* + 1. In this way we obtain {F, U, t), that 
is a proper {kq + 2:)-©(Set Cover instance and t = t* + 1 < a|C/'|. Observe that in the final 
instance we have \U\ < n + q + z and | < (en + q)'^ + 1, which is a polynomial since k,c,q and 
z are constants. 

To summarize the reduction, we have taken an instance of (/i;,c)-©SPARSE-SET Cover and 
iterated over the size of solution. Next we made the size divisible by q by adding additional 
elements to the universe and created a multiset family F* from which we made a set family by 
differentiating identical sets with additional elements of the universe. Our goal was to decide 
whether the /c-0iSET Cover instance {F' , U') (for k' = kq + z) has odd number of set covers, 
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which means that wc want to control the correspondence between the parity of the number 
of solutions in each part of the construction. Observe that the only step of the construction 
which has nontrivial correspondence between the number of solutions of the former and the 
latter instance is the grouping step where we transform an instance {Tq, Uo,jo) into a multiset 
instance {T* ,U*,t*). 

Hence we assume that we know the parity of the number of set covers of size t* = jo/q in 
{F* , U*) as well as the parity of the number of set covers of size / for each / < jo in {J^o, Uo). 
Our objective is to compute the parity of the number of set covers of size jo in (J^Oj Uq) in 
polynomial time and for this reason we introduce a few definitions and lemmas. Recall that 
each set in J-"* corresponds to a union of exactly q sets in J-q and let F : J-"* — > 2-^" be a function 
that for each set in J"* assigns a family of exactly q sets from J^o that it was made of. Moreover 
let S* C 2-^* be the family of set covers of size t* in (J"*, U*) and let Sq C 2-^° be the set of set 
covers of size at most jo in {To, Uo)- We construct a mapping $: 5* — > 5o which maps each set 
cover A E S* to a set cover S Sq such that Aq is exactly the set of sets from J^q used in the 
t* unions of q sets from J^o, that is = {J-^^^T{X). In the following lemma we prove that 

for a set cover Ao G So the size of ^~^{Ao) depends solely on the size of ^o- 

Lemma 4.10. Let Ao,Bo G Sq such that \ Ao\ = \Bo\. Then \^'^{Ao)\ = \^'^{Bo)\. 

Proof. Let Ao = {Xi, . . . ,Xa} be a set from So, where each Xi G J^o- Observe that for any 
AeS* we have = ^o if and only if (J"=i r(Xj) = A. Consequently |$"^(Ao)| is equal to 

the number of set covers of size t* in the set system {(^°),Ao) and hence |^>~^(Ao)| depends 
only on the size of ^o- D 

Now we prove that for each set cover Ao G So of size jo an odd number of set covers from 
S* is mapped by $ to ^o- 

Lemma 4.11. For any nonnegative integers a,b such that b < a the binomial coefficient (^) is 
odd if and only i/ones(6) C ones(a), where ones(a;) is the set of indices containing ones in the 
binary representation of x. 

Proof. For a nonnegative integer x by f{x) let us denote the greatest integer i such that xl is 
divisible by 2*, that is 



Since [fj = f^K^^-by. ^^^^^ if) '^^'^ '^^^^ f^^) ^ /(^) + /("^ ~ which 

by the above formula is equivalent to |ones(a)| = |ones(6)| + |ones(a — However for any 
nonnegative integers x, y we have oncs(.T + y) < ones(a;) + oncs(y) and moreover ones(x + y) = 
ones(x) + ones(y) if and only if there are no carry-operations when adding x to y, which is 
equivalent to ones(a;) fl ones(y) = 0. 

Therefore by setting x = b and y = a — b we infer that (^) is odd if and only if ones (6) n 
ones(a — 6) = which is equivalent to ones(6) C ones(a) and the lemma follows. □ 

Lemma 4.12. Let Ao G So such that \Ao\ = jo then \^~^{Ao)\ is odd. 




i>i 




i>l 




i>l 
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Proof. Since \^ "^(^o)l is equal to the number of set covers of size t* in the set system (( Aq) 
and \Aq\ = jo = t*q we infer that |$~^(^o)| is equal to the number of unordered partitions of 
^0 into sets of size q. Hence |$~^(^o)| = ni=o^ {^"'q-i^'^)- Since jo is divisible by q and g is a 
power of two using Lemma 4.11 we have |<5~"'^(^o)| = 1 (mod 2). □ 



For j = 1, . . . , jo by Sj let us denote the parity of the number of set covers of [Tq, Uq) of size 
j modulo 2. Recall that we know the value of Sj for each j < jo and we want to compute sj^ 
knowing also |5*| mod 2. By Lemma 4.10 we can define dj for j = 1, . . . , jo, that is the value 
of |$~^(^o)| mod 2 for a set Aq G Sq of size j. By Lemma 



4.12 



we know that dj^ equals one. 



Thus we have the following congruence modulo 2. 



E I* 

AoGSo 



JO 



-1 



+ sjdj 



Hence knowing mod 2 and all values sj for j < jo in order to compute Sj^ it is enough to 
compute all the values dj, what we can do in polynomial time thanks to the following lemma. 

Lemma 4.13. For each j = 1, . . . , jo we can calculate the value of dj in polynomial time. 

Proof. Again we use that fact that for a set ^o £ '^o we have that |<I>^^(74o)| is equal to the 
number set covers of size t* in the set system (('^''),^o)- Using the inclusion-exclusion principle 
modulo two we obtain the following formula when |^o| = J- 



\<f-\AQ)\^ ^ 



XCA^ 







n c 



X 



E 

i=0 



Where the second equality follows by grouping all summands X Aq with \X\ 
< i < \Aq\. 



i for every 

□ 



Consequently by solving a polynomial of n number of instances of the k'-(BtSET Cover 
problem with universe size bounded hy n + q + z and set family size bounded by {cn + qy + 1 we 
verify whether the initial set system C 2^ has an odd number of set covers, which finishes 
the proof of Theorem 4.5 □ 



5 Summary and Open Problems 

We have shown that the exponential time complexity of a number of basic problems is strongly 
interconnected. Specifically, our results imply that the optimal growth rates of a a number 
of problems are in fact asymptotically equal. Assuming SETH, our results imply tight lower 
bounds on the growth rates for a number of search problems whose growth rates are achieved 
by naive brute force algorithms. For problems solvable by dynamic programming, we gave tight 
lower bounds assuming that the optimal growth rate of Set Cover is achieved by its known 
dynamic programming algorithm. Finally, we connected the two types of results by showing 
that SETH implies tight lower bounds on the optimal growth rates of corresponding parity 
variants. We conclude our work with some open problems. 

1. Is it possible to rule out an algorithm for Set Cover with running time 2'''m'^(i), e < 1, 
assuming SETH? 

2. Is it possible to rule out an algorithm for Graph Coloring with running time 2*^", 
e < 1, assuming SETH? What about a lower bound for Graph Coloring under the 
assumption that there does not exist a 6 < 1 such that Set Cover with sets of size at 
most k has a 0(2'^"m'^(^^) time algorithm for every k? 
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3. Is it possible to rule out an algorithm that counts the number of proper c-colorings of an 
input graph in time 2'^", e < 1 assuming ©-SETH? 

4. Assuming SETH, is it possible to rule out an algorithm with running time 2^"n'^(i), e < 1 
for the satisfiability of circuits with at most cn gates of unbounded fan in, for a concrete 

constant c? 

5. Assuming SETH, is it possible to rule out an algorithm with running time 0(c") for 
3-CNF-Sat for a concrete constant c? 
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A Problem definitions 



©Bipartite Independent Set 

Input A bipartite graph {A U B, E) where \A\ = n, \B\ = m. 
Question Is the number of independent sets odd? 

A;-CNF-Sat 

Input A CNF formula consisting of m clauses of size at most k and on n variables. 
Question Is there a satisfying assignment? 

eCNF-SAT 

Input A CNF formula consisting of m clauses of size at most k and on n variables. 
Question Is the number of satisfying assignments odd? 

Connected Vertex Cover 

Input An integer t and a graph G = {V, E). 

Question Is there a subset X CV such that \X\ < X n e / for every e & E and G[X] is 
connected? 

©(Connected Vertex Cover 

Input An integer t and a graph G = {V,E). 

Question Is the number of subsets X C. V such that \X\ = t, X fl e 7^ for every e E E and 
G[X] is connected, odd? 

Hitting Set 

Input An integer t and a set system C 2^ where \J^\ = m, \U\ = n. 

Question Is there a subset H CU with \H\ < t such that fl 5 / for every S" G J^? 

©Hitting Set 

Input A set system C 2^ where = m, \U\ = n. 

Question Is the number of H C U such that i7 n S 7^ for every S e T odd? 
it-NAE-SAT 

Input A CNF formula consisting of m clauses of size at most k and on n variables. 

Question Is there an assignment so that each clause contains literal set to true and a literal 
set to false? 

fe-SET Cover 

Input An integer t and a set system C. 2^ where = m, \U\ = n and for every S & J^, 
\S\ < k. 

Question Is there a subset C C JF with \C\ < t such that Usee S = U1 
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A;-©tSET Cover 

Input An integer t and a set system C 2^ where \T\ = m, \U\ = n, for every S e T, \S\ < k. 
Question Is the number of C C T with \C\ = t such that Usec S = U odd? 

n, for every S ^ F,\S\ <k. 
= U and for every S,S' & 

(fc,c)-SPARSE-CNF-SAT 

Input A CNF formula consisting of m clauses of size at most k and on n variables, where 

m < cn. 

Question Is there a satisfying assignment? 

(A:,c)-©Sparse-CNF-Sat 

Input A CNF formula consisting of m clauses of size at most k and on n variables, where 
m < cn. 

Question Is the number of satisfying assignments odd? 
(A;,c)-Sparse-Hitting Set 

Input An integer t and a set system T C 2^ where \T\ = m < cn, \U\ = n and for every 

5 e J", \S\ < k. 

Question Is there a subset H C U with \H\ < t such that fl 5 / for every 5 G J^? 
(/c,c)-® Sparse-Hitting Set 

Input A set system J" C 2^ where | = m < cn, \U\ = n and for every S e J^, \S\ < k. 
Question Is the number of subsets H CU such that fl 5 7^ for every S e T, odd? 

n, for every S e T, \S\ < k 

m 

(fc,c)-®SPARSE-SET Cover 

Input A set system T where = m, \U\ = n, for every S ^ F,\S\ <k and m < cn. 
Question Is the number of C C J" with IJ^ec S = U odd? 

fc-SET Splitting 

Input A set system C 2^ where \T\ = m, \U\ = n, for every S e T, \S\ < k. 

Question Is there a subset X CU such that, for every S e T, neither S C X nor S C {U—X)l 

Steiner Tree 



k-Set Partitioning 

Input An integer t and a set system F where \F\ = m, \U\ = 

Question Is there a subset C C. F with |C| = i such that IJseC ^ ~ 
with 5 7^5', = 0? 



(A;,c)-Sparse-Set Cover 

Input An integer t and a set system C 2^ where \T\ = m, \U\ = 

and m < cn. 

Question Is there a subset C C J^, such that |C| < t and (JseC ~ 
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Input An integer t and a graph G = {V,E) with terminals T CV. 
Question Is there a subset T C X CV with |X| < t and G[X] connected? 

©tSTEiNER Tree 

Input An integer t and a graph G = {V, E) with terminals T C y. 

Question Is the number of subsets T C X C F with |X| = t and G[X\ connected, odd? 

Subset Sum 

Input Integers oi, . . . , a„ G and a target integer t on m bits. 
Question Is there a subset X C {1, . . . , n} with Yliex ~ ^'^ 

c-VSP-CiRCUiT-SAT 

Input A cn-size Valiant series-parallel circuit over n variables. 
Question Is there a satisfying assignment? 
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